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' MATHEjtv^ PROJECT 
. TE^ER'S INStW/o/ SHEET-tVALUATION 



An iiupjrtant aspect. of tRfc Mathematical Problem Solving, Project is 
ttie evflliation of the problem serving modules". We would like to have 
yourvTig^ponses to several area^of the evaluation. 

'Time Reco rd - Instructipjial Booklet See attached form ' 

2. Time Record - Problem/^eck See attached form * 



3. ^mments anyRecoir m^dationg^ the lessone Space is provided in the^ 
^^acher:s ed1t1oh/or ^comments and recommendations you have. T^ere 
^ ; ^are several specific questions which we have about each^sson". 

' . (1) . Does ' the JiBsson give adequate emphasis to each oboierctiver 
•» . . u) Was the /Wesson ^Ir organised? - 

(3) Did'^fehe^tudentsTind the lesson easy, to use? ^ " "J 

(4) Many ^Ker questions; might occur to you. 

*' 4! lessory Rjftinq Form See a'tta'ched frfrm . , 

■ . • _// ■ " ^' , , 
Y ConwieBfts an d .Recomniendations on the Problem Deck Write'^any comments 
^ ai}«/econinendat1ons you have on the -Problem Deck pages. There are 
/fF""^^ specific questions we have'aboiit the problem deck. For ex- 
y W?' "'^^* were the students' reactidVls to the problems in the . 
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f- Y ■ . ' \ ■ - - ■ . ■ , , 

6' Teachers" 'D ebrie'ftr»q. Questionnaires \These forms are not included in 
. tnis packet. .-They wi>ai be distribute^ and completed at ins^vice - 
programs after you fir\ish different pFhtses of the moduTe^You will 
be asked to respond to. specifig questions and asked for suggestions 
• f-pr improving the module. 

Polttest (quiz) A'Wort quiz has been developed tq. hdb us determine 
■the effectiveness of thejboklet- am^roblem deck.^^ quiz is not 
. a measure of yo^^r teaching effectiveness and will not be: used as "T" 
such^ "J — 

' ■ *- '."■*■ ■• 

We. are looking forward to receiving your comments and suggestioi^ . 

"Thank you. Vy^ . • ''J ' 
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TIME RECORD INSTRUCTIONAL BOOKLET 



Module 



Teacher 



Length (in minutes) of your reguliar matljematics period 



Day 1 : 
Date: 



Time: 

' Start 

. End ) 



TotaT 



Pages covered: 

Day. 2' : 
Date: v 



fb'me': 
Start 
End 

TotaT 



Pages covered: 
Day 3: 

Date^ ■ ■ 



Time: 
• Start_ 
End 



TotaW 



Pages covered: 

're test (if use«j||fi». 

Da te :' 



Total time: 



Day 4 : 
Date: 



, Time: 
^ Start 

. End 

TotaT 



Pages eoverfed:j_ 
■ Da^ 5 : ' 



Date 



\ 



Time: 

Start 

.End 
^ TotaT 



Pages covered: 
Day 6 : * 
Date: 



* Pages covered: 

V 

Posttest - 
Date: 



Total time: 



1 





- — *i \ ' : 


Time: 4. 


f ■ ■■ • ' 


* StarF^ 


A ' * 


End ) . 


Total 


■^1 . ^ 



, * (If more delys are needed use the back of this sheet.) 
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Module 



tiME RECORD > PftOBlEM DECK 



Teacher 



1 


2 




4 


5 


6 ' 
■• 


7 • 


8 

t. 


9 


10 


11 


12 

• 


1.3 


14 

^ ) i '^ 




16 


li 


16 


19 


20 








-1 . _ . - . 










2'2 . ' 


2^ 

it 


24. . 

J' 


25 


26 " 




•28 . 


■ I 
















30 ;/ 


31 ;. 

• 






', / 





Describe the pro6;§dures, including grouping of students, you. used 
for implementing the problem deck. / • 



2. 



cribe the methods you used for monitonng sttident perfdrmance on 
problem deck. ; 



3* Please write liny additional comments about the problem deck on Hbe 
back of this/page. ' " \ ' 



MPSP " 
LESSON RATING FORM 



Module ^ . 

Teache r ^ , . . 

^- ■•■ ■ " ■ ■ , ■ ' ■ ■ ^ 

1. How appropriate is the .lesson for^the ability level of your students? 
(Circle one for each lesson.) 



Lesson 1 
Lesson 2 
Lesson 3 
LessQ^n 4 
Lesson ,5 



Inappropriate 



2 
2 
2 
2 
2^ 



3 
3 
3 
3 



Appropriate 

4 5 

4 '5 

4 5 

4 5 

4 5 



2. How appropriate 1s the lesson Tor the overall purpose of this mo^iule? 



Lesso{|-l' 
Lesson 2 
Lesson* 3 
Lesson 4 
Lesson 5 

/ 



Inafipropriate 

, • . • , V 1 2 

1 ' 2' 



Appropriate 



3 
3 
3 
3 
3 



4 

/• 4 

' A 
4 



5 
5 
5 
5 
5- 



3. How useful were the teacher notes for eaich lessdn? 



Inappropriate 



Lesson 1 
Lesson 2 
Lessen 3 
Lesson 4 
Lesson 5 



2 
2 

'2 
2 
2 



3 
3 
3 
3 
3 



'4 • 

4 

4 

'4-- 
4 



Appropriate " 
5 



TEACHER DEBRIEFING QUESTIONNAIRE, INSTRUCTIONAL BOOKLET 

OBJECTIVES / ' .Yes No Not Sure 

1. Are, the objectives 

clearly stated? ^ " 



2. Are the objectives con- 
sistent with one another?^ 

3. Is appropriate emphasis siveni 
to each object! ve?^' 

4. Does the content adequately 
cover t^e material specified 

' in the/ oj)j6ctive^? 

• . / ' ' ' ^ . 
DISPLAY/MD format ' 

- — y ^ > ^ 

the format apf)rojjriate 
fop the /intended 'population * 
/in tarms.vof ess^ of ' use? 

■ Si Does the dlsplay^format avoicf 
/ a crowded appearance? ^ 



7- (If a student booklet \s used) ' / <^ 

Is the sentence striictifre and 

vocabulary clear, simple, and ^ 
straightforward? . , 



8. (If a student booklet is usec^ 
Are the ins truest ions to the ' 
learner complete,- clear, and. 
> easy to follow? 



CDNtENT AWALYSIS 



\ 



V 



9. Have adjustments been made to 
the instructional material to 
accommodate learners of dif- 
ferent aptitudes? „ . 

- ■ . ' f" ■ ' ' 

10. Is the content free from* 

factual and technical errors? ' * . ■ ; ^ 

11. Does the product avoicj ov^- . - ' . ^ 
sizing topics which 
t merit detailed" tn 

ment? 



emphasizing topics which • 

not merit detailed" treat- \. 

V/ 



A^, III A.5 



12. 



13. 



. i 



4. 



15. 



16 i' 



Does the product begin at 
a point which is familiar 
ti&^the Tearrter?. ^ ^ ' • 

Is the product organized 
for the sequential, devel- 
opment of concepts/skills, 
it is designed to teach? 

. Does the product avoi d . 
extreme variations in the ^ 
'difficulty of the j:ontent? 

A(If ,a student booklet is used) 
Are content examples in^c^Vi 
estirtg and illustrations at- 

. tractive and well-chosen? 

(If sr'ltHdenVbooklet is used) 
Are examples and illustrations 
.drawn from activities n^ated 
to the probable intereiK of 
your studentst?r - 



if. 



Does the product avoid 
"talking down" to the learner? 



Yes No 



"Not Sure 



1 



\ 



Describe the (grouping procedure(s) you, used for the instructional 
booklet? . . .V / 



> . • DISCUSSION QUE5ThN^, INSTRUCTIONAL BOOKfET ' - 

1. . What coirments do>u have with respect to the amount of time required 
A to use the .instructioaal booklet? ( Probe ; suggestions for revising" 

V. the booklet with" respect to length, viz.. addit;ix)ny and deletions) 

2. (If a studept 'booklet was used) Did the students, 5eem to enjoy the 
, format (including artwork) of the booklet? - ( Probe : .examjjles) 

• 3, Is the booklet self-contained?' ( f robe : where additi:onal' explana- 
^ ^^ Vt^on is required 

4. Af^er the ^^first phase of the module did yo'u observe any changes in 
^js^i^. . your students WT \ ^ ' 

V (-a) ^ttitud^s)about problem solving? ^ • 

(i>) ab-y y:i es -to sol ve . probl ems? 
. (c) others? , \ 

5. What were your studeritsV^a^ during this phase of the module? 'S- 

•JPJC^: w^ll^ngnes#^ipefeeyerance^changes^j£ attltO^^ 
\ toward each^lesson J ^ < 

6. Is there any ambiguity^With respect to tha jobjectives for eacff 
lesson? (Probe: 'specific lessoJS) 



■AC 



7. What additional suggestions do you-have)^^ people' who are going 
' to revise the instructional booklet? ^ . . 

8. Other questions mi gJtj,t:6ccar to you. 



[" -J DISCUSSION QUESTIONS, PROBLEM DECK 

. ■ V. ... - ■ . 

Ability levels iand interests . ^ ^ 

a. Did students of certain ability le^vels use the ^rob^m deck 
more than others? ^L»^ ' ' " 

b. Does the deek include an adequate nljmb^r of prohl ems for stu- 
dents of low ability? high ability? „• ^ 

^"c/ bid the'^udeats have any difficulty finding* problem?^ appro- 
priate for t\eir interests? Explain. .• 
. Relationship^of instructional booklet and the problem deck 
a* A|f|^he' problems consistent with the instipuctional booklet? ^ 



\ ■ 



, ( Probe ; similarities' and differences) 

b. XWhat'was thie effect of the instructibna^l bookjiet ^P^"^® 5*^" 
) / depts' performance on the problem deck? Explain. , ^ 

c. Would ^he problem deck be more or less effective it it were used 
^' be^ the instructional bookie^? . Exp|ai 

Preferenys $ \^ ^ ^ 

a. If students selected their own problems did th^y chooise the more 
difficult problems? easy problems? ^ " . 

b. Did ^he students^ show <«»y preference for real-world problems^ puz- 
"^zle problems, pr some other identifiable type ^e.g., content)? 

Time ^ - 

' ' ' ■ ' \ \ ' ' ' 

a; A!Jput"how long did a student (or t£ram) spend on a problem "card? 

■ . " ■ . ■ ^ . } ■ ■ 

b. How\many days » do you feel are the right length of time to use 

♦ ' ' ^ ' . .* 

the problem-rdeck? ' \ 

c. Did the students ask to use i;he cards/dyi^ing "frefJtime?" ( Probe ;' 
' How frequently? How many students?) <» ^ * • 



i a. Did your students seem to enjoy working with the problem deck?* 



Explain, s 



b. Did the studen^ seem to enjoy working with "cards?" ( Probe :^ 
art work) "S^ _ J 

6.^ Others ' . * 

• — - V ■ ■■ • ,. • ■ 

a.' Was there any difficulty with students waitiw^^o^ answers, in- 
stnuctions,? and/or dlp^ctiop when finished with a problerp? ' 
Explain. ^ ,^ 

«^''''" b. (If^hints were on-the cards) WeVe the hints used, o p the cards 
that^ have them? Would mor^ hints- be^ desirable? ^pl^in. 



7« Other questions might occur to you • 



/ 



J 



r if 
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MODULE DEBRIEFING - DrSCUSSIOfi QUESTIONS 



., Responses to these diseuss.idn questiAns should be obtained -verbainy 

. at this session. ^ ' • . ' • " / " ^ 

-• ' 1-. Considering the" eritire module, what seems to have been most auccess- 
" " ful, and what least successful? ' 
2. Wh^t in^he students' fe^^ most? /eft sappoin ted,/ 

. >you?--^ ■ ^^v.- v;^--;:'^ • ^ Y' 

' *3v-' Were there groups of students who diflnU respond well to the module 

_ "and its content^ ; 
•"4V Did^^^^ students\"'at1;itudes vary duJTng the different phases of the-^ 
^ ■ ' (PrSbe_: ' specific examples) 

■ 5. Do you. have any corpents and suggestions with.respect to the tihie re- 
. . quirements for the module related to • , 

a • teacher preparation? - , >* 



' b. stadent classrddiTh work? 

6. a. Did you supplement the module in^'any way by preating*different 

\ : activities or using' other materials? ( Probe :^ examples) J 

b. What supi^lementary instrpctiohal materials (if any) would be ° - 
- ■ ■ ' ■ . . V ■ I- . 

useful (e.g., transparencies, slide-tapes, manipulatives)? 

7. Was the amount of instruction, prpvided by the module- sufficient for 
' your students to meet the objectives of the module? ^ 

. 8. ' What wojjTd you want to ds differently if you were to teaph this 
module again? 



III A-lOv, 
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9/nibat 4ugqestlQn? wod'ld you offer- ^ teacher who was abbut to use the 
module for the first ^tljnef 

0. What final 're9pmn'6ndat1olis" do you ha for 

' 7 ■ ■ . / 



I 



«e moduli 



r 
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The intervil^l with'the~"teachers shQuld be done infonnaUy. tfelow is^ 

■ ^ . ■ • ^ ' ' ■ ■ 

suggested sequence ^nd questions. -to bp 

Sectjoip I: ■ Setting the context for the interview . . ^ 

V: iDyring the past several weeks, we at Indiana have beelti going over 
ill of the evailuation ^iata ,frpm the last trial of th^ modules. , 
• 2. AsVresult of examining the evaluation data", we have identified 
' a few areas whkh perhaps, were not|tiiscus\^d during the in-service 

sessions and/or .areas which we vtould like to get a better Veel for. 

3. There are three general reasons for the interviews we ar« having * 

today: ' ^ 

, (a) To provide ad»i£ional details of, what happened during the trial; 

(b) To identify successes and failures, strong and weak points of 
the modCile; ■ ' 

(c) To identify your \deas about the MPSP and the two modules you 
have tried^ A ' v ^ 

4. We have listeiied to recordings of ^ome of your meetings and have 
gotten a great deal of valuable feedback. There were 3ome points . 
that we heard on the tapes or saw in the written feedback that We 
want to pursue further, so my questions might sound a bit redundant 

at times. , 

5. With your permission,' I would, like to record our talk. ♦ • 

. 6. Do you have any questions? Please fee vW tfr ask any questions 
at any time. . ' 



r SpCTItJN II: INFORMATION RELATED TO SECOND MODULE TRIAL \ ' ^ 



Question 



R^ated 'Probe Tot)ics 



1 . To help me better ujidersfand what-Vou 
wilT be saying,, "cou J d. you tell me what 
/ \yojLir class 'is like, this year? I- 



/ 



- ability level .' ^ ' 

- degree of teacher dependence 

- (SES) ba'flJkground 
-j^eneral deportment ' ' " 



2: How do^ypu organize^ typical day? 



* — r 



"range of. grouping procedures , > „ 
range^ of teacher: roles 
> ' - modes^; ^ * 

"/ - stra|egies, £tc. 
specifically , what does math typically 
look liVe 



3. How did you organize y6ur class for 
- the use of the instrucfiional booklet? 



' 1 

'tTme?J 



why? 



why? 



■grouping 

what way(s)? 
change overti 
. teacher 

' ■ what did (s)he do? , 
\ change overtime? ^ 

special external factors during use? 

(e:g. , snow days) . 
didv^:hey have an effect? I 

timing ' ^ 

one lesson/day? 4^ 

^ on consecutive days? 

• length of sessions 

RECOMM£tl^ATlONS. 



4. How did you organize your class fc 
use of the problem deck? 



- grouping 
what way(s 
change ove 

-teacher ^ 



" 7 

rtime? J 



why? 



what did (s)he do?J ^^y. 



change overti _ 
special external factors during useZ- j-- 

did they have an effect? - 
timing ? 
on| lesson^day?' ■ 
consecutive ■<iays? 
length of sessions 
^COMMENDATIONS 
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15 



^eStJ 



on ^ ' 



Relateci Probe Topics ^ 



^ 



a 



5. Now that^you^'ve tompVeted the whole 
Wduli, would you. do it the Sttne*way 
again? v ^ . 



6. How did it go 
. the, instructiona 
problem deck? > 




(for each respective part:) 
^ - Jroupjng? ' 
-"teacher role? • 
timi^ng , 



moved from 
t to the 



7; What/do you think the rrtojdule was 
designed to. do? J 



8. What' did you think if these 
materials? 



9- WMit was 'f^l*^ I successful in the 



Idule?^ 



:ohteW ^ ^ • . 

» r adequate preparation in booklet? 
, feasabilHy of: ^problem deck ^Idne? 

probl^ deck ) 

boiiiq^t? \r 



management ' 



booJclet al6ne? 



did Kijds understand how to use ^ 
materials? K 

were kids jabl-e to adjust t(v-grouping 
changes (Hf any)? / / ' 



- is goal reasonable for kids? ^ 

specif teal ly > were kids read^ for 
these materla^ls?- 

- was content consistent with goal? 

- do you think kfds reached goal? 

all kids? some? none? 
evidence of achievement or lack of 
* was sequence of lessons r^asorrable? 

- RECOI^ENDATIOrlS 



appeal across ability levels? 
differences between booklet' and deck , 
differences between module and regular 
math re: content 

difficulty level 
RECOMMENDATIONS' 
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SECTIO.N III: INFORMATION i^ELATED TO~TH£ TOTAL PR'og! 




Question 



Related Probe Topics 



"T 



1. Could studentsr^lo' better oH th/ second 
. trijitdule^fter having thi^l-i^st? ■ ^ 



\ 



2. ¥<iU"*have given two modul'es»now. each 
' .w+th somewhat, dtf/erent formats./ 
Whicti worked bet't.er f,or ypu? 



; 3.- Db you think your .students had the 
'pr^ecequisife knowledge and/or skills 
to Team (the first) module? 



4. Was tlievt ime spent on these 
' materials worth it? . 



5.^ Were there reactions to these 
materials? . 



6. Did you have adequate support for 
' your effort? 



7. Did your kids grow? Atong what 
dimensions? 



- familiarity with program 

- ^o^ouifeel better about the program? 

- mosV^successfiil /least successful idfea * 

' >Ljdents nu/; : dblf to solve problems! 
af ter J||<i^g two modules rather than jbf$t 
. one? ' ' • 



- which Better for kids? 

- RECOMMENDATIONS' 



- in place of other math? 

- re: effects on math, and/or other 
subjects <. 



comments from parents, (and kids) 
comments from non-participating teachers, 
priiTcipal , etc.* • . < 



aid jprom MPSP peQD'fe 
instructional (mat^rpal ) aids? 
e.g., transparerKies, etc. i 
RECOMMENDATIONS - ^ 
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